Programming Abstractions for Managing Workflows on Tiered Storage Systems

Scientific workflows in High Performance Computing ( HPC ) environments are processing large amounts of data. The storage hierarchy on systems is getting deeper, driven by new technologies (NVRAMs, SSDs, etc.) There a need for programming abstractions that allow users to seamlessly manage data at the workflow level multi-tiered systems, and provide optimal performance use resources. In previous work, we introduced software architecture Managing Data Tiered Storage Workflows (MaDaTS used Virtual Space VDS abstraction hide complexities underlying system while allowing control management strategies. this article, detail data-centric around its layer. simplify scientific without affecting or capacity. We measure overheads effectiveness MaDaTS. Our results show these can optimally capacity lesser tiers, adding any overheads.